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REMARKS 

Claims 6-10, 16-20, and 22-24 are pending in the application. Claims 
1-5, 11-15 and 21 were previously canceled. Independent claims 6, 16, 22, and 23 
have been amended by this amendment. 

The key to the disclosed and claimed invention lies in the structure of the 
8-bit electronic watermark information illustrated in Figure 10 of the drawings, 
and as described in the paragraph bridging pages 5 and 6 of the specification. As 
illustrated and described, the high-order four bits of an 8-bit watermark contains 
information defined by the electronic watermark promotion organization, 
mentioned on page 6 of the specification. The electronic watermark organization 
is DVD Copy Protection Technical Working Group (DVD CPTWG) as described 
in Appendix I, attached to this amendment. Appendix I was taken from the IBM 
Web site whose URL address is http://www.research.ibm.com/trl/projects/ 
RightsManagement/datahiding/dhvgx__e.htm. The DVD CPTWG issued a Call for 
Proposals for a suitable standard and the Galaxy group including NEC, the 
assignee of this application, made proposal in 1999. The proposed standard is 
described in Appendix II, attached to this amendment. Appendix II was also taken 
from the IBM Web site http://www.research.ibm.com/trl/projects/ 
RightsManagement/datahiding/dhvg2__e.htm. Appendix III, attached to this 
amendment, is a paper published March 2, 1999, entitled "Galaxy Watermark 
Technology for DVD Copy Protection" which names Hitachi, IBM, NEC, Pioneer 
and Sony as members of the Galaxy group and provides further description of the 
proposed standard. The present invention is based on this proposed standard. More 
particularly, the disclosed and claimed invention makes use of the undefined bit- 
data in the electronic watermark information for performing a function (i.e., 
executing an instruction) other than copy protection. 

Claim 6, as amended, recites "A device that detects an electronic 
watermark from a compressed original image, which electronic watermark 
includes information consisting of first bits defined as CCI (copy protection) bits, 
second bits defined as reserved and third bits as undefined bit-data" (emphasis 
added). This device includes, inter alia, "a circuit which detects electronic 
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watermark data embedded in data for which IDCT has been performed along with 
the value of said bit-data for which is defined a plurality of instructions", "a table 
file including one of said instructions for said value of said bit-data", and "a 
circuit which performs a processing according to said instruction in said table 
file" (emphasis added). In other words, claim 6 makes quite clear that what is 
being done within the copy protection scheme is quite unrelated to the function of 
copy protection. Rather, the undefined bits are being used to contain bit-data, the 
value of which is used to access a table of instructions. The instruction identified 
by the value of the bit-data is then executed. The executed instruction could be for 
any purpose. This allows the watermark to be used not only for copy protection 
but also for many other purposes. 

Claim 16 recites "A method for detecting an electronic watermark from a 
compressed original image, which electronic watermark includes information 
consisting of first bits defined as CCI (copy protection) bits, second bits defined as 
reserved and third bits as undefined bit-data' (emphasis added). This method 
includes, inter alia, the steps of "performing inverse discrete cosine transform 
(IDCT) for said decoded data obtained from said decoding step", "detecting 
electronic watermark data embedded in data for which IDCT has been performed, 
along with the value of said bit-data for which is defined a plurality of 
instructions" , and "performing processing according to an instruction obtained 
from a table file including a plurality of instructions corresponding to values of 
said bit-data and which includes an instruction for said value of said bit-data" 
(emphasis added). Claim 22 recites "A computer-readable recording medium 
storing therein a program for detecting an electronic watermark embedded in an 
original image, which electronic watermark includes information consisting of 
first bits defined as CCI (copy protection) bits, second bits defined as reserved 
and third bits as undefined bit-data" (emphasis added). The program causes the 
computer to "read a compressed image data and a table data, said table data 
defining a plurality of instructions corresponding to said bit-data included in said 
electronic watermark" (emphasis added). The program further causes the 
computer to "perform processing according to one of said instructions in said 
table corresponding to said bit-data included in said electronic watermark" 
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(emphasis added). Claim 23 recites "A device that detects an electronic watermark 
from an original image, which electronic watermark includes information 
consisting of first bits defined as CCI (copy protection) bits, second bits defined as 
reserved and third bits as undefined bit-data from an original image" (emphasis 
added). This device includes, inter alia, "a circuit which detects said electronic 
watermark from said original image data along with the value of said bit-data for 
which is defined one of a plurality of instructions", "a table file including said 
plurality of said instructions corresponding to values of said bit-datd\ and "a 
circuit which performs processing according to one of said instructions in said 
table file corresponding to the value of said bit-data contained in said original 
image" (emphasis added). 

The Examiner had previously rejected claims 6-10, 16-20 and 22-24 
under 35 U.S.C. § 103(a) as being unpatentable over U.S. Patent No. 6,310,962 to 
Chung et al. in view of U.S. Patent No. 6,374,036 to Ryan et al. This rejection is 
respectfully traversed for the reason that the combination of Chung et al. and Ryan 
et al. do not show, teach or otherwise suggest the claimed invention. 

Both the patents to Chung et al. and Ryan et al. are specifically directed to 
copy protection based on the electronic water mark. Neither of the references, 
mentions or proposes any user for the undefined bit-data upon which the claimed 
invention is based. The claimed invention makes use of the undefined bit-data in 
the electronic watermark information of a proposed standard for performing a 
function (i.e., executing an instruction) other than copy protection. There is no 
suggestion in the prior art of the claimed invention. 

In view of the foregoing, it is respectfully requested that the application be 
reconsidered, that claims 6-10, 16-20 and 22-24 be allowed, and that the 
application be passed to issue. 

Should the Examiner find the application to be other than in condition for 
allowance, the Examiner is requested to contact the undersigned at the local 
telephone number listed below to discuss any other changes deemed necessary in a 
telephonic or personal interview. 
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A provisional petition is hereby made for any extension of time necessary 
for the continued pendency during the life of this application. Please charge any 
fees for such provisional petition and any deficiencies in fees and credit any 
overpayment of fees to Attorney's Deposit Account No. 50-2041. 



Whitham, Curtis & Christofferson, P.C. 
1 1491 Sunset Hills Road, Suite 340 
Res ton, VA 20190 

Tel. (703) 787-9400 
Fax. (703) 787-7557 

Customer No.: 30743 



Respectfully submitted, 




C. Lamont Whitham 



Reg. No. 22,424 



Watermark Standardization for DVD Copy Protection 




Watermark Standardization for DVD Copy 
Protection / Galaxy 



* This research project has been completed. 

On February 17. IBM, NEC, Pioneer, Hitachi, and Sony announced the formation of the 

Galaxy group to merge watermarking proposals for DVD copy protection, and on March 
2 they submitted a unified proposal on video watermarking to the DVD Watermark Review 
Panel (WaRP). IBM's Tokyo Research Laboratory technology was selected as a core 
technology of the Galaxy group's proposal. 

• Galaxy Proposal 

• DataHiding Technology for Video 



■ Background story of DVD copy protection 



A DVD is a 4.7-gigabyte removable storage medium, and can accommodate two and a 
half hours of MPEG-2 encoded motion picture data. Hollywood expects that DVD will 
expand the home video market on account of its clear visual quality, just as CD audio 
spurred a remarkable growth in recorded music sales from 1988 to 1995. But they are 
also afraid that the prevalence of casual piracy may destroy the potential DVD market, 
since MP3 and the Internet are generating casual CD audio piracy and harming the 
recorded music market. (See b^kgroundLstory on the music recording industry .) In 1996, 
the Motion Picture Association of America (MPAA), the Recording Industry Association 
^ of America (RIAA), consumer electronics manufacturers, and information technology 
\y companies formed the DVD Copy Protection Technical Working Group^CPTWG) to 

protect the new business~oiip^^ from casual piracy. 

The DVD CPTWG began by launching an encryption approach called Content Scrambling 
System (CSS) in 1997. However, no encryption approach can prevent illegal copying 
through the analog output of a DVD player or stop circulation of unauthorized copies 
from person to person. Thus, CSS is not sufficient for protection against casual piracy. 

Hi IBM was the first proposer of copy and playback control by watermarking 

Watermarks survive digital-analog conversion. In September 1996. IBM's Tokyo Research 
Laboratory (TRL) first proposed the use of watermarking technology for DVD copy 
protection at the DVD CPTWG. and showed that the TRL technology can detect 
embedded watermarks in both uncompressed and MPEG-2-compressed domains. This led 
to the development of a new framework in which DVD recording and playing devices 
automatically prevent unauthorized recording and playback of unauthorized copies by 
means of Copy Control Information (CCD detected in digital video content. The new 
framework contains direct and aggressive measures to promote copy protection, but does 
not violate the privacy of consumers, unlike the conventional digital watermark 
framework, which was based on a "monitoring" and "tracking" approach whereby a 
system is assumed to embed a consumer's personal information invisibly in digital content 
for tracking purposes. 

Data Hiding A^^c^ic^ Framework 
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Watermark Standardization for DVD Copy Protection r 




M Data Hiding Sub-Group (DHSG) formed under DVD CPTWG 

The new framework, which controls recording and playback by means of watermarks, 
requires the standardization of watermarking for effective implementation in consumer 
DVD devices. In May 1997 the Data Hiding Sub-Group (DHSG) was formed under the 
DVD CPTWG, and issued a Call for Proposals (CFP). The CFP defined a set of 
requirements, ranked as either essential or desirable. The essential requirements are as 
follows: 

Call for Proposals issued by the DHSG in July 1997 

• Transparency 

• Low-cost digital detection 

• Digital detection domain: The digital detection can be done in the source data 
(uncompressed digital video), MPEG-2 compressed elementary data, a multiplexed 
stream (program/transport), and/or logical sector data. 

• Generational copy control for one copy 

• Low false positive detection rate: no error lasting 10 seconds in 400 hours of 
operation. 

Consumer electronics manufacturers now claim no error ;n "316.890 years" instead of no error in 
"400 hours.") 

• Reliable detection 

• Ability of watermark to survive normal video processing in consumer use. 

• Licensable under reasonable terms 

• No restrictions on export/import 

• Technical maturity 

• Data payload; three states (Never copy, No More Copying, and Copy Once) and an 
additional 2 bits for APS at a minimum. 

■/the DVD CPTWG agrees to 8 bits of data payload) 

• Minimum impact on content preparation 

• Data Rate; at least 1 1.08 Mb/s 

Return to top of page 
m Eleven Proposals Reduced to Two in February 1 999 

The eleven proposals submitted in response to the CFP were subjected to the visual and 
survivability tests using common sample clips, in October 1997 and February 1998, 
respectively. In May 1998 the DHSG issued an interim report entitled "Results of Phases 
I and II" and IBM's proposal had the best survivability in the DHSG test This report led 
the merging of the original eleven watermarking proposals into three by July 1998: an 
IBM-NEC proposal, a Pioneer-Hitachi-Sony proposal, and a Macrovision-Digimarc-Philips 
proposal. The watermarking technology of IBM's Tokyo Research Laboratory was adapted 
as the core of the IBM~NEC proposal. Consumer electronics companies such as Pioneer, 
Hitachi, and Sony have a strong interest in the transparency of watermarking. Beginning 
at the end of 1998, the IBM-NEC group and the Pioneer-Hitachi-Sony group held a 
sequence of meetings to evaluate the proposals technically. As a result Pioneer, Hitachi, 
and Sony admitted that the IBM~NEC watermarking technology offers an acceptable level 
of transparency by allowing automatic visual control of the embedding processor. Thus, in 
February 1999, IBM, NEC, Pioneer, Hitachi, and Sony announced the Galaxy team for 
standardization of watermarking for DVD copy protection. 
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Japanese page Is here. 

Galaxy Proposal for DVD Copy Protection 




* This research project has been completed. 
m Galaxy Watermark Proposal March 2, 1999 

We propose the Galaxy watermarking technology and system, comprising a Primary Mark 
and a Copy Mark, for preventing unauthorized recording and playback of copyrighted 
video content on consumer devices and PCs. While the main focus of the proposed 
system is DVD, it may also be applicable to satellite, cable, and other means for 
electronic distribution of video content. The system offers playback control, recording 
control, and generational copy control according to four copy protection states - "Copy 
Freely." "Copy Once," "No More Copying" and "Never Copy" - which are specified by 
the Primary Mark and Copy Mark in the video content. 

A Primary Mark is an 8— bit transparent digital watermark that is embedded in digital video 
data. The Galaxy technology allows a compliant device to detect a Primary Mark in both 
the baseband (uncompressed) and MPEG^2 compressed domains. The first two bits of a 
Primary Mark are Copy Control Information (CCI) and represent "Copy Freely," "Copy 
Once," and "Never Copy" in the case where there is no Copy Mark. The next two bits 
are APS trigger bits. The remaining four bits are reserved for the use of the content 
owner. 

A Copy Mark is another transparent digital watermark, which does not interfere with a 
Primary Mark The Galaxy technology allows a compliant device to insert and detect a 
Copy Mark in both the baseband and MPEG-2 domains. A DVD recorder inserts it into 
'Copy Once" content to change the status to "No More Copying" for the purpose of 
generational copy control. 



Record Copy and Generational Copy Control: 

A detector sends a signal to the recording controller to stop or insert noise when it 
detects "Never Copy" or "Copy Once" with a Copy Mark. 

Playback Control: 

A detector sends a signal to the playback controller to stop or insert noise when it 
detects "Never Copy" or "Copy Once" with a Copy Mark in recordable/ rewritable media. 

The Galaxy technology offers highly transparent and secure Primary Marks and Copy 
Marks. They survive digital-analog conversion. MPEG~2 coding/encoding, and various 
types of signal processing. The Galaxy detector uses the adaptive period detection 
algorithm to detect Primary Marks with a predetermined false positive error ratio. Even in 
heavily degraded contents, reliable detection can be achieved without exceeding the 
predetermined false positive ratio, which is set to less than 1CT 12 for ten seconds, through 
a trade off that involves extending the detection time window. Primary Marks survive 
successive processes of studio video processing. MPEG-2 compression. VHS recording, 
and MPEG-2 recompression. The applied studio video processes include brick wall 
filtering, aperture enhancement noise reduction, 98% speed reduction. 50% watermark 
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Galaxy Watermark Proposal 
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blending, letterbox conversion, offset letterbox conversion, random spatial shifting, and 
hue shifting. 



• Background Story of DVD Copy Protection 

• DataHiding Technology for Video 

• Science and Technology of DataHiding 



DataHiding Ho me Page 
Last modified 16 Feb 2001 
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Galaxy Watermark Technology 
for DVD Copy Protection 



March 2, 1999 
Hitachi Ltd., IBM Corporation, NEC Corporation 
Ptoneer Electronic Corporation, Sony CoVpoJatton 
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Outline 



System architecture 
Copy-Once function 
Technical maturity 
Gate Count Analysis 
Survivability tests 
False positive analysis 
Watermark Embedding Technology 
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Watermark Features 



Unified primary watermark 

High visual quality with automated .mage quality adjustment 
-High solvability with unified waterman design 
Adaptive frame accumulation 

Translatktnal Search Capability 

-Transnational search with h.gh ccmpulabon effioency 

sJZ%£££~ ra " d0m Spafta ' Shl " ° f 

"£JE£? 'J 30 ' 1 "? by anal >' zin 9 video (frame averagmg. subtract™ etc) 
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^WMaJk lns«rtion Technology 



Fu "£ safis ^ system requirement 
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Record Control in DVD Recordable Devices 



Recorder with MPEG a „d baseband input 



- □ 



Recorder with baseband mput 
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Watermark detection and Copy Mark insertion can be done in 
MPEG & baseband domain 
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(3) Technical Maturity 
GALAXY Watermark Function Description 
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Galaxy Watermark Function 



Automated Watermark Embedding System 

-Automated optimizing process 

* Image quality adjustment 

. Optimize embedding strength 
-Pixel by pixel adjustment capability 

Watermark Detection and Copy Mark insertion Logic 

-Watermark detection from MPEG2 brt stream 
-Watermark detection from baseband 
-Copy Mark insertion mtc MPEG2 b< stream 
-Copy Mark insertion into baseband 
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Watermark Detection Implementation 




Logle-1 

(MPEG domain) 
Playback Control 



LogJc-2 

(MPEG domafn) 
Playback Control 
Record Control including 
Copy Mark insartfon 



Logic -J 

(Baaaband domain) 
Playback Control 
Racord Control Including 
Copy Mark incartfon 



DVD-Ortv**>tay«r 



DVD-Rrconlabfe davtcaar 



Standakma Digital 
Recorder Exampla 




MPE02 
Stream 




MP€<32 
Slrvam 




X 




Copy Made cfctactwo 



Primary w»t«tm*rt( dotoctKWi 
Copy Mart d*toctton 
Copy Mark Irturtton 



Pitmmrf uswttmark 6m tm ebon 
Copy M«fk d«t»ct>on 
Copy Marie !rw*rticK> 
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(4) Gate Count Estimation 
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&mw«C ton Copy Control 


w*t»rmar* d»t»ctto««f»d Copy M«r« 
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C~n»r«k»n Copy Contro* 


fmwtlon (ft hwl—m domain 
A^lcottvwnhm. 
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DVD r*com*bt. d**t»5 wtth " 







DVDWG Document W/CFCR02-2 

(5) Survivability Tests 



Survivability tests 
Consumer environment tests 
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Survivability Verification Test 



SU ™**™d!^T eS a " DHSG equivalent test items 

Letterbox conversion (frame/field) 
Offset letterbox conversion r frame/field) 
Speed reduction (98%) 
Mark blendng (50%, 75%) 

SU< ^ F S r^ lly SUrVlVes follow *ng consumer domain tests 

uppp ™W*<°» ("Mbp«. CBR, ♦ MPEG re^orn.res™ 
Hue-shfttng ( 30 degree hue shiftmg}- 

SW SSS ta9 real ^casting channe, 
HD down conversion survivability was successfully tested 
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Random Picture Shifting Test 



Dtsplay r«g»n ^ 
Overscan re^on TV Bezel 
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Analog Cable/DirecTV Transmission Test 
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Survivability of Primary and Copy Mark 
through MPEG re-co mpression with VHS recording 



WM 

Embedding 

"10011101'* 




Galaxy Watermark survives s 

MPEG compresswn, VHS record 
and MPE G ro-oompressmn 



WM Detected 
"1001 1101" 
+ Copy Mark 
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HDTV down conversion survivability 



WM | ^ 

Embedding III tC8CM> 
"10011101- I M — ' — 



**" conversion lotiowng by MPE< 



'Tested vttfi actual dev.ce ana 
<hr** Afferent types of software 
down conveners 
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(6) False Positive Analysis 



f^S&g*" 0,de,eCti0 " " nal d ' S,ribuS0n from «™*- — 
-Detection value from each bit is ^dependent from each other 
-Dec.s,on (3 made by the bit wrth leastsigna. strength 



Unmarked Video 
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False Positive Error 



Detection Threshold is determined by the 
false positive error requirement 




Fafse Positive Error 



Accumulated Signal X 
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Threshold vs. False Positive Ratio 



Target ratio (e) of false posrtrve 
errors 


Threshold (T) for 8-bit detection 


10-8 


1 85878 


10-9 


1 98372 


10-10 


2 10306 


10-11 


221752 


10-12 


2 32729 


10-13 


2 44118 



-Theoretical analyse based on 8 brt detection 
-False positive error per detection penod (10s 
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(7) Watermark Embedding Technology 



Automated Image Quality Adjustment 

-High visual quality adjusted pixef by pixel 

-High reliability achieved by maximizing tie embedding signal 

Great freedom of the watermark embedding process 

-Embedding system has CCIR601 mput and output 

Embedding system can be placed anywhere in the video producton process 

Same watermark can be detected in MPEG and baseband 

-Equivalent detection reliability and mathematical model 
-Sharing single common detection fogsc 

Primary watermark is orthogonal to the Copy Mark 

-No disturbance or conflict between Primary watermark and Copy Mark 
-Independence from the Copy Mark provtfe security bamer for Pnmary watermark 

Watermark is designed to embed arbitrary 8-bit information 

-Common test con d it on defined by DHSG 

-First four bits were defined for CCI (CGMS and APS) 

Real-time Studio Embedding System 

-D1 input and output with few frame delay 
-PC based system with DSP 



